Blended physical and virtual realities

ABSTRACT

Techniques for providing blended physical and virtual reality experiences are disclosed. In some embodiments, a pose of a camera of a device located in a venue is determined based at least in part on three-dimensional asset recognition in a field of view of the camera, wherein the field of view of the camera comprises an actual physical view of the venue; a virtual view corresponding to the actual view is obtained from existing assets comprising a specification of a virtualized version of the venue; and display of the virtual view is facilitated at the venue. Thus, a virtual reality of a physical space is provided while at the physical space based on actual three-dimensional objects detected or recognized in the physical space.

CROSS REFERENCE TO OTHER APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationNo. 62/579,786 entitled BLENDED PHYSICAL AND ONLINE RETAIL EXPERIENCEfiled Oct. 31, 2017, which is incorporated herein by reference for allpurposes.

BACKGROUND OF THE INVENTION

Existing mixed physical and virtual reality systems and applications aretypically limited due to the corresponding physical space or environmentnot being well defined. Thus, improved blended reality systems andapplications that overcome existing limitations are needed and disclosedherein.

BRIEF DESCRIPTION OF THE DRAWINGS

Various embodiments of the invention are disclosed in the followingdetailed description and the accompanying drawings.

FIG. 1 is a high level block diagram illustrating an embodiment of anetwork environment in which a service or application for blendingphysical and virtual realities is provided.

FIG. 2 is a high level flow chart illustrating an embodiment of aprocess for facilitating display of a virtual view.

DETAILED DESCRIPTION

The invention can be implemented in numerous ways, including as aprocess; an apparatus; a system; a composition of matter; a computerprogram product embodied on a computer readable storage medium; and/or aprocessor, such as a processor configured to execute instructions storedon and/or provided by a memory coupled to the processor. In thisspecification, these implementations, or any other form that theinvention may take, may be referred to as techniques. In general, theorder of the steps of disclosed processes may be altered within thescope of the invention. Unless stated otherwise, a component such as aprocessor or a memory described as being configured to perform a taskmay be implemented as a general component that is temporarily configuredto perform the task at a given time or a specific component that ismanufactured to perform the task. As used herein, the term ‘processor’refers to one or more devices, circuits, and/or processing coresconfigured to process data, such as computer program instructions.

A detailed description of one or more embodiments of the invention isprovided below along with accompanying figures that illustrate theprinciples of the invention. The invention is described in connectionwith such embodiments, but the invention is not limited to anyembodiment. The scope of the invention is limited only by the claims,and the invention encompasses numerous alternatives, modifications, andequivalents. Numerous specific details are set forth in the followingdescription in order to provide a thorough understanding of theinvention. These details are provided for the purpose of example, andthe invention may be practiced according to the claims without some orall of these specific details. For the purpose of clarity, technicalmaterial that is known in the technical fields related to the inventionhas not been described in detail so that the invention is notunnecessarily obscured.

Techniques for blending physical and virtual realities are disclosedherein. In some embodiments, in order to provide a different or moreenhanced viewing experience than actual reality, a user is presentedwith a view that is at least in part, if not completely, virtualized.For example, a user currently present in a physical scene is providedwith a virtualized version or rendering of the scene instead of anactual view of the scene seen by a camera of an associated user device,e.g., with respect to a viewfinder or display associated with thecamera. In some such cases, the virtualized view or rendering issubstantially identical to the actual view in terms of geometry andillumination. Substantially perfect or exact correspondence between theactual and virtualized views results from having comprehensiveforeknowledge of the associated physical environment and maintaining afully simulated replica or virtualized version of the physicalenvironment from which photorealistic renderings of any desiredarbitrary perspectives of the physical environment may be retrievedand/or generated. Substituting an actual view with a correspondingvirtual view facilitates various interactive applications such as thereal time ability to customize or modify objects comprising a view,change selectable options associated with objects comprising a view,configure selected options via virtual overlays on objects comprising aview, etc. In some embodiments, a virtualized or rendered view of ascene is provided via a user device display or other dedicated displaywhile the user is physically immersed in the actual physical scene andhas the opportunity of experiencing the tangible and tactile effects ofpresence in the actual scene, thus resulting in a blended or mixedreality user experience. Moreover, the disclosed techniques facilitatevarious other applications such as treating recognized objects in acurrent field of view of a user device camera similarly to barcodes toautomatically provide or surface additional information and/orselectable options associated with detected objects and, thus, eliminatethe need for barcodes to encode such information.

FIG. 1 is a high level block diagram illustrating an embodiment of anetwork environment 100 in which a service or application for blendingphysical and virtual realities is provided. In this embodiment, theservice comprises client-side and server-side components. That is, theservice comprises a mobile application that communicates with a serverapplication. In other embodiments, the service may comprise a webapplication, with the client and server communicating via a webinterface, or, generally, the service may comprise any other appropriatearchitecture. The blended physical and virtual reality service hosted byserver 102 is provided to a plurality of user devices such as device 104in the example of FIG. 1. A client-side application is installed on eachdevice 104 that communicates with server 102. Device 104 in the exampleof FIG. 1 is depicted as a cellular or mobile phone. However, generally,device 104 may comprise any other computing device that is capable ofcommunicating with server 102, such as a tablet computer, laptopcomputer, virtual or augmented reality device or headset, etc.Communication between server 102 and device 104 is facilitated vianetwork 106, which may comprise any combination of one or more public,private, wired, and/or wireless networks, such as a cellular/mobilenetwork or the Internet.

As depicted in FIG. 1, the user of device 104 is located within aprescribed venue 108. In the given example, venue 108 comprises thebuilding of a home furnishings retail store in which the user isshopping. Generally, venue 108 may comprise any indoor or outdoorphysical space or environment. The venue 108 and/or the part of venue108 at which device 104 is located is known to server 102, for example,based at least in part on one or more signals available with respect todevice 104 that may be employed for presence detection of device 104 atvenue 108 and/or at a specific section of or location within venue 108(e.g., a prescribed floor, department, aisle, etc., of a retail store orin proximity to a prescribed access point or beacon). Moreover,foreknowledge of architectural elements as well as other objectscomprising venue 108 exists at server 102. Specifically, a virtualizedversion of venue 108 and/or parts thereof are stored server-side inassets database 110. In some embodiments, for instance, prior to theblended physical and virtual reality service being available for a givenvenue, assets database 110 is pre-populated with a specification of thevenue that comprises assets (e.g., three-dimensional mesh models and/orimages/photographs/renderings) from which photorealistic renderings ofany desired arbitrary perspectives of the venue may be retrieved and/orgenerated.

A server-side specification of a virtualized version of venue 108 isbased on foreknowledge of the layout or floorplan of the venue, such as,for example, known information about the architectural structure of thevenue such as surfaces (walls, ceiling, floor, windows, doors), edges,corners, etc.; known types and locations of lighting fixtures at thevenue; known types and locations of prescribed surface textures at thevenue; known specifications of potential objects and object combinations(e.g., products and/or product displays and placements) at the venue;etc. In some embodiments, assets database 110 stores definitions of oneor more three-dimensional mesh models of the venue or parts thereof(e.g., objects comprising the venue) from which a photorealisticrendering comprising any prescribed perspective of the venue and objectcombinations and permutations may be generated. In some embodiments,assets database 110 stores a plurality of images or views of the venueor parts thereof that span diverse perspectives from which aphotorealistic rendering comprising any desired arbitrary perspective ofthe venue and object combinations and permutations may be retrieved orgenerated.

Presence of device 104 at venue 108 and/or a specific part thereof maybe determined from one or more signals available with respect to device104 that can be employed to determine or infer location of device 104. Adescription of some examples of signals that may be employed todetermine, estimate, or track a current location or position of device104 follows. GPS (Global Positioning System) signals may be used toidentify locations in outdoor areas or environments. Cellular networksignals may be used to triangulate locations in both outdoor and indoorcontexts. WiFi (wireless local area network) signals and similarlyBluetooth or BLE (Bluetooth Low Energy) signals may be used totriangulate indoor locations. For instance, signal strength measurementswith respect to different wireless access points or beacons within anindoors venue may be used to determine specific locations within thevenue. In some cases, a dedicated presence detection architecture (e.g.,transmitter network) based on any appropriate (electromagnetic) signaltype may be deployed within a venue and used to determine location orposition. Furthermore, sensor (e.g., compass, magnetometer,accelerometer, gyroscope, etc.) signals available at device 104 may beused to determine location. Generally, any combination of one or moresignals may be employed for coarse and/or fine location determination ofdevice 104.

In some embodiments, a location of device 104 in venue 108 and/or aposition or pose (e.g., height, angle, rotation, tilt, etc.) of device104 at a prescribed location in venue 108 may at least in part bedetermined via computer vision based recognition techniques foridentifying known assets. In such cases, a camera of device 104 isemployed, and the precise location and pose of the camera of device 104is determined or estimated. More specifically, recognizable objects in acurrent field of view of the camera of device 104 are identified, e.g.,via two-dimensional and/or three-dimensional tracking of depth,features, hue, saturation, etc., based on known assets 110. In somecases, specific object locations or positions within venue 108 areknown, such as for objects comprising permanent or semi-permanentfixtures or landmarks (e.g., architectural elements, lighting fixtures,decorative artwork such as framed paintings or sculptures, etc.) orintentionally introduced fiducial markers. In such cases, the locationor pose of device 104 may be determined based at least in part on knownlocations or positions of detected elements or objects that are presentin a current camera field of view. Alternatively, some objects may bemovable within venue 108. In such cases, object locations or positionsmay not be known and may have to be determined based on one or moreother objects in the camera's current field of view whose locations orpositions are known and/or other location or position detectiontechniques. During object recognition, constraints on placements ofmovable objects in the venue may be employed to narrow the search of theassets database to a smaller subset of the entire database. As anexample, a particular department of a retail store may be constrained toinclude only a prescribed subset of all available products sold in theretail store. Thus, the database search during object recognition may atleast in part be constrained to a small subset of the entire assetsdatabase based on at least some known location information of thedevice.

Based on determined real time location and pose of device 104 (and henceof the camera of device 104) and detected objects in the current fieldof view of the camera, a rendering comprising a virtualized version ofthe current field of view of the camera of device 104 is generated atserver 102 from assets available in database 110 and provided to device104 for display instead of and/or in addition to the actual real timeview seen or framed by the camera of device 104. In some embodiments, aview displayed at device 104 is completely virtualized, i.e., comprisesa rendering of the current camera field of view that does not includeany of the actual view seen by the camera of device 104. Alternatively,in some embodiments, a view displayed at device 104 comprises a blended,augmented, or mixed reality view that includes at least some of theactual view seen by the camera. In some such cases, for instance, arendering received from server 102 may be overlaid or superimposed on anactual view seen by the camera of device 104 to generate a compositeview. A view may be rendered to have precise or consistent lighting thatcorresponds to the lighting of the actual view since information aboutthe locations and types of lighting fixtures at the venue are known.That is, known locations and types of lighting may be related withdevice/camera pose to generate a rendering having correct lighting thatcorresponds to or matches the actual lighting at that perspective in thevenue. Alternatively, a view may be rendered to have different lighting.For example, a user may desire to replace actual lighting in a storewith user specified or selected lighting so that the user can simulatehow a particular product or product display appears in such lighting.

The disclosed techniques for providing an at least partially, if notcompletely, virtualized or rendered view rather than simply providing acounterpart actual view offer many novel features and applications. Forexample, because of comprehensive foreknowledge of a venue and possiblescene compositions within the venue as well as the ability to exactlyidentify location and pose, the disclosed techniques facilitatedetermination of the precise real time view or perspective of the venuebeing seen or framed by a camera, i.e., in the field of view of thecamera, as a user of the corresponding device moves through the venueand points or aims the device/camera to capture different perspectiveswithin the venue. Determination of scene composition and perspective(i.e., camera location and pose) facilitates substituting or replacingan actual view as seen by a camera with a virtual or rendered view,which may be substantially identical to the actual view or may comprisean alternative or enhanced version of the actual view. In someembodiments, a virtual or rendered view may be communicated to anddisplayed on a dedicated augmented reality screen or display in additionto and/or instead of a display associated with the user device.Providing a virtualized or rendered view facilitates dynamicmodifications to configurable or selectable options associated with ascene or parts thereof. For example, a user viewing a scene comprising asofa may select to change the fabric and color of the sofa and bepresented with a rendered view corresponding to the selections in realtime. Furthermore, content may be added to or removed from a virtualizedor rendered view, e.g., automatically or based on user specifications.For example, a user may specify the addition or removal of certainobjects while planning a room in front of a room display at a furniturestore; one or more extraneous objects (e.g., trash laying on the floor,other customers in the frame, etc.) present in an actual view may beautomatically removed in a virtual or rendered view; items or objectsmay be intentionally added into a virtual view, e.g., to satisfy productplacement contracts with advertisers, etc.

Precisely identifying and locating three-dimensional elements or objectsin a physical scene in real time, e.g., as the scene is viewed from acamera, based at least in part on known assets associated with the sceneand computer vision based recognition as described herein issubstantially a different problem and has a different solution than, forexample, identifying two-dimensional elements in images, which canreadily be identified using standard two-dimensional image processingtechniques. Moreover existing location detection techniques typicallyidentify proximity and not the precise or exact location/pose orperspective of a device (i.e., of the camera of the device with respectto a viewed scene) as described herein. Furthermore, detailed tagging ofan asset in database 110 facilitates surfacing of additional informationor options with respect to an identified or recognized object, such as,for instance, an associated web page (e.g., a product page) or hyperlinkthereof, video, three-dimensional animation, augmented realityanimation, instant bidding, ordering, purchasing, etc. For example, insome embodiments, a user may access such additional information oroptions associated with an object by simply pointing or aiming a userdevice/camera at the object in a physical space. Thus, the describedtechniques support physically based navigation of information andoptions, eliminating the need for physical tags or barcodes to accesssuch information, which do not seamlessly integrate with the aestheticsof the physical scene.

FIG. 2 is a high level flow chart illustrating an embodiment of aprocess for facilitating display of a virtual view. For example, one ormore steps or sub-steps of process 200 may be performed by the clientand/or the server of the client-server application architecturedescribed with respect to network environment 100 of FIG. 1. In someembodiments, process 200 comprises a dynamic, real time process.

At step 202, the location and pose of a user device within a venue isdetermined. That is, in some cases, step 202 comprises determining apose (e.g., relative position and orientation) of a camera of the devicewithin the venue. Coarse and/or fine location of the device at the venueor a prescribed part of the venue may be determined from one or moresignals available at the device such as GPS signals, cellular signals,WiFi signals, Bluetooth or BLE signals, other electromagnetic signals,sensor signals, etc. A finer, more precise location of the device and/orthe pose of the device at a prescribed location may be determined basedat least in part on three-dimensional asset recognition in a field ofview of the camera using any appropriate computer vision techniques foridentifying or recognizing known assets. With respect to theclient-server application architecture of FIG. 1, for example, locationmay at least in part be determined client-side and communicated to theserver, and/or information used for determining location (e.g., signalsfrom which location can be determined or inferred) as well as pose(e.g., current actual view in the field of view of the camera) may becommunicated to the server for (finer, more precise) determination oflocation and/or for determining pose server-side.

At step 204, a virtual view that corresponds to an actual view of thevenue in a current field of view of the camera is obtained, for example,from existing assets comprising a specification of a virtualized versionof the venue. The existing assets may comprise one or morethree-dimensional polygon mesh models and/or images spanning a pluralityof perspectives of the venue and/or parts thereof. In variousembodiments, the virtual and actual views may comprise (substantially)the same camera pose, the same perspective of the venue, the same sceneof the venue, the same scene geometry, the same scene lighting, etc. Insome embodiments, the virtual view comprises an alternative or augmentedversion of the actual view. For example, the virtual view may compriseone or more scene elements having different configurations or selectableoptions than the same scene elements in the actual view. In someembodiments, the virtual view comprises a photorealistic quality orresolution. Alternatively, in some embodiments, the virtual view may notbe photorealistic and perhaps instead may be a cartoon or animationversion of the actual view. With respect to the client-serverapplication architecture of FIG. 1, for example, the server obtains thevirtual view by retrieving or generating (i.e., rendering) the virtualview from existing assets, and the client obtains or receives thevirtual view from the server.

As step 206, the virtual view is displayed. The virtual view may bedisplayed in real time as the corresponding actual view is captured inthe field of view of the camera of the device. In some cases, displayingthe virtual view comprises replacing or substituting the actual viewwith the virtual view. In some cases, displaying the virtual viewcomprises overlaying the virtual view on top of the actual view. In someembodiments, the displayed virtual view facilitates surfacing ofadditional information or available options with respect to objectscomprising the view. In various embodiments, the virtual view may bedisplayed on a display of the device or communicated to a dedicateddisplay or screen at the venue that displays virtual reality (VR) oraugmented reality (AR) views. With respect to the client-serverapplication architecture of FIG. 1, for example, the server facilitatesdisplay of the virtual view by providing the virtual view to the clientfor display, and the client facilitates display of the virtual view on adisplay of the client device or another external display.

The disclosed techniques facilitate providing blended physical andvirtual reality experiences. As described, a virtual reality of aphysical space is provided while at the physical space based on actualthree-dimensional objects detected or recognized in the physical space.

Although the foregoing embodiments have been described in some detailfor purposes of clarity of understanding, the invention is not limitedto the details provided. There are many alternative ways of implementingthe invention. The disclosed embodiments are illustrative and notrestrictive.

What is claimed is:
 1. A method, comprising: determining a pose of acamera of a device located in a venue based at least in part onthree-dimensional asset recognition in a field of view of the camera,wherein the field of view of the camera comprises an actual view of thevenue and wherein three-dimensional asset recognition is constrained toa prescribed set of objects with placement constraints on movableobjects; obtaining a rendering of the venue corresponding to the actualview of the venue from one or more existing assets comprising aspecification of a virtualized version of the venue, whereinforeknowledge of the venue and existing assets comprising thespecification of the virtualized version of the venue exist prior to thedevice being located in the venue; and facilitating display of therendering of the venue by replacing the actual view of the venue ascaptured by the camera with the rendering of the venue, wherein therendering of the venue is completely virtualized and does not includeany of the actual view of the venue and wherein the rendering of thevenue comprises one or more interactive features including userconfigurable options for one or more objects comprising the rendering.2. The method of claim 1, wherein the rendering of the venue and theactual view of the venue have substantially the same camera pose.
 3. Themethod of claim 1, wherein the rendering of the venue and the actualview of the venue both comprise substantially a same perspective of thevenue.
 4. The method of claim 1, wherein the rendering of the venue andthe actual view of the venue both comprise substantially a same scene ofthe venue.
 5. The method of claim 1, wherein the rendering of the venueand the actual view of the venue both comprise substantially same scenegeometry.
 6. The method of claim 1, wherein the rendering of the venueand the actual view of the venue both comprise substantially same scenelighting.
 7. The method of claim 1, wherein the rendering of the venuecomprises an alternative or augmented version of a scene comprising theactual view of the venue.
 8. The method of claim 1, wherein therendering of the venue comprises at least one scene element having adifferent configuration than that same scene element in the actual viewof the venue.
 9. The method of claim 1, wherein obtaining the renderingof the venue comprises retrieving the rendering of the venue fromexisting assets.
 10. The method of claim 1, wherein obtaining therendering of the venue comprises generating the rendering of the venuefrom existing assets.
 11. The method of claim 1, wherein existing assetscomprise one or more three-dimensional mesh models.
 12. The method ofclaim 1, wherein existing assets comprise one or more images spanning aplurality of perspectives.
 13. The method of claim 1, wherein therendering of the venue is displayed in real time as the actual view ofthe venue is captured in the field of view of the camera.
 14. The methodof claim 1, wherein the rendering of the venue comprises aphotorealistic rendering.
 15. The method of claim 1, wherein existingassets comprising the specification of the virtualized version of thevenue facilitate generating renderings of the venue, including therendering of the venue, having any desired arbitrary perspectives of thevenue.
 16. The method of claim 1, wherein facilitating display of therendering of the venue comprises facilitating display of the renderingof the venue on a dedicated display at the venue.
 17. The method ofclaim 1, wherein the rendering of the venue facilitates surfacing ofadditional information associated with one or more objects comprisingthe rendering.
 18. The method of claim 1, wherein the pose of the camerais determined based at least in part on one or more signals available atthe device from which pose is determined.
 19. A system, comprising: aprocessor configured to: determine a pose of a camera of a devicelocated in a venue based at least in part on three-dimensional assetrecognition in a field of view of the camera, wherein the field of viewof the camera comprises an actual view of the venue and whereinthree-dimensional asset recognition is constrained to a prescribed setof objects with placement constraints on movable objects; obtain arendering of the venue corresponding to the actual view of the venuefrom one or more existing assets comprising a specification of avirtualized version of the venue, wherein foreknowledge of the venue andexisting assets comprising the specification of the virtualized versionof the venue exist prior to the device being located in the venue; andfacilitate display of the rendering of the venue by replacing the actualview of the venue as captured by the camera with the rendering of thevenue, wherein the rendering of the venue is completely virtualized anddoes not include any of the actual view of the venue and wherein therendering of the venue comprises one or more interactive featuresincluding user configurable options for one or more objects comprisingthe rendering; and a memory coupled to the processor and configured toprovide the processor with instructions.
 20. A computer program product,the computer program product being embodied in a non-transitory computerreadable storage medium and comprising computer instructions for:determining a pose of a camera of a device located in a venue based atleast in part on three-dimensional asset recognition in a field of viewof the camera, wherein the field of view of the camera comprises anactual view of the venue and wherein three-dimensional asset recognitionis constrained to a prescribed set of objects with placement constraintson movable objects: obtaining a rendering of the venue corresponding tothe actual view of the venue from one or more existing assets comprisinga specification of a virtualized version of the venue, whereinforeknowledge of the venue and existing assets comprising thespecification of the virtualized version of the venue exist prior to thedevice being located in the venue; and facilitating display of therendering of the venue by replacing the actual view of the venue ascaptured by the camera with the rendering of the venue, wherein therendering of the venue is completely virtualized and does not includeany of the actual view of the venue and wherein the rendering of thevenue comprises one or more interactive features including userconfigurable options for one or more objects comprising the rendering.21. The system of claim 19, wherein the rendering of the venue and theactual view of the venue have substantially the same camera pose. 22.The system of claim 19, wherein the rendering of the venue and theactual view of the venue both comprise substantially a same perspectiveof the venue.
 23. The system of claim 19, wherein the rendering of thevenue and the actual view of the venue both comprise substantially asame scene of the venue.
 24. The system of claim 19, wherein therendering of the venue and the actual view of the venue both comprisesubstantially same scene geometry.
 25. The system of claim 19, whereinthe rendering of the venue and the actual view of the venue bothcomprise substantially same scene lighting.
 26. The system of claim 19,wherein the rendering of the venue comprises an alternative or augmentedversion of a scene comprising the actual view of the venue.
 27. Thesystem of claim 19, wherein the rendering of the venue comprises atleast one scene element having a different configuration than that samescene element in the actual view of the venue.
 28. The system of claim19, wherein to obtain the rendering of the venue comprises to retrievethe rendering of the venue from existing assets.
 29. The system of claim19, wherein to obtain the rendering of the venue comprises to generatethe rendering of the venue from existing assets.
 30. The system of claim19, wherein existing assets comprise one or more three-dimensional meshmodels.
 31. The system of claim 19, wherein existing assets comprise oneor more images spanning a plurality of perspectives.
 32. The system ofclaim 19, wherein the rendering of the venue is displayed in real timeas the actual view of the venue is captured in the field of view of thecamera.
 33. The system of claim 19, wherein the rendering of the venuecomprises a photorealistic rendering.
 34. The system of claim 19,wherein existing assets comprising the specification of the virtualizedversion of the venue facilitate generating renderings of the venue,including the rendering of the venue, having any desired arbitraryperspectives of the venue.
 35. The system of claim 19, wherein tofacilitate display of the rendering of the venue comprises to facilitatedisplay of the rendering of the venue on a dedicated display at thevenue.
 36. The system of claim 19, wherein the rendering of the venuefacilitates surfacing of additional information associated with one ormore objects comprising the rendering.
 37. The system of claim 19,wherein the pose of the camera is determined based at least in part onone or more signals available at the device from which pose isdetermined.
 38. The computer program product of claim 20, wherein therendering of the venue and the actual view of the venue havesubstantially the same camera pose.
 39. The computer program product ofclaim 20, wherein the rendering of the venue and the actual view of thevenue both comprise substantially a same perspective of the venue. 40.The computer program product of claim 20, wherein the rendering of thevenue and the actual view of the venue both comprise substantially asame scene of the venue.
 41. The computer program product of claim 20,wherein the rendering of the venue and the actual view of the venue bothcomprise substantially same scene geometry.
 42. The computer programproduct of claim 20, wherein the rendering of the venue and the actualview of the venue both comprise substantially same scene lighting. 43.The computer program product of claim 20, wherein the rendering of thevenue comprises an alternative or augmented version of a scenecomprising the actual view of the venue.
 44. The computer programproduct of claim 20, wherein the rendering of the venue comprises atleast one scene element having a different configuration than that samescene element in the actual view of the venue.
 45. The computer programproduct of claim 20, wherein obtaining the rendering of the venuecomprises retrieving the rendering of the venue from existing assets.46. The computer program product of claim 20, wherein obtaining therendering of the venue comprises generating the rendering of the venuefrom existing assets.
 47. The computer program product of claim 20,wherein existing assets comprise one or more three-dimensional meshmodels.
 48. The computer program product of claim 20, wherein existingassets comprise one or more images spanning a plurality of perspectives.49. The computer program product of claim 20, wherein the rendering ofthe venue is displayed in real time as the actual view of the venue iscaptured in the field of view of the camera.
 50. The computer programproduct of claim 20, wherein the rendering of the venue comprises aphotorealistic rendering.
 51. The computer program product of claim 20,wherein existing assets comprising the specification of the virtualizedversion of the venue facilitate generating renderings of the venue,including the rendering of the venue, having any desired arbitraryperspectives of the venue.
 52. The computer program product of claim 20,wherein facilitating display of the rendering of the venue comprisesfacilitating display of the rendering of the venue on a dedicateddisplay at the venue.
 53. The computer program product of claim 20,wherein the rendering of the venue facilitates surfacing of additionalinformation associated with one or more objects comprising therendering.
 54. The computer program product of claim 20, wherein thepose of the camera is determined based at least in part on one or moresignals available at the device from which pose is determined.